Universal Access To All Knowledge
Home Donate | Store | Blog | FAQ | Jobs | Volunteer Positions | Contact | Bios | Forums | Projects | Terms, Privacy, & Copyright
Search: Advanced Search
Anonymous User (login or join us)
Upload

Reply to this post | Go Back
View Post [edit]

Poster: Administrator, Curator, or StaffTyler Date: Oct 1, 2005 1:29am
Forum: etree Subject: lossless download zip link contains all 4 formats of a show (mp3, flac, ogg, 64k mp3) instead of just the flacs...

The 'download whole lossless show' link on this show:

http://www.archive.org/compress/swllc2005-08-26.mk4.nbox.flac16

is a zip, but instead of holding just the flac files of the show as expected, the zip contained the entire file contents of the entire file set (every ogg, flac, vbr_mp3 and 64k mp3), totaling 640MB. The total file size of only the .flac files was 364 MB. Since the link displays 640 MB it must interpret the zip file has all the file types in that one file.. this is a bug / mistake on the ziping I believe ... hasen't something similar to this been reported in the past?

show details page:
http://www.archive.org/audio/etree-details-db.php?id=29322&from=browseRecent

EDIT: I guess this has been brought up before:

http://www.archive.org/iathreads/post-view.php?id=41958

http://www.archive.org/iathreads/post-view.php?id=44156

just wanted to make sure you guys knew about it .. ;)

This post was modified by Tyler on 2005-10-01 08:29:40

Reply to this post
Reply [edit]

Poster: Administrator, Curator, or StaffMatthew Vernon Date: Oct 2, 2005 3:11am
Forum: etree Subject: Re: lossless download zip link contains all 4 formats of a show (mp3, flac, ogg, 64k mp3) instead of just the flacs...

The behavior you describe happened when the archive changed to doing "zip on the fly". Previously, the zip files were created and stored with the show. Zip files were created for the lossless format (flac/shn) and for the two mp3 formats but not ogg. This assumes that those formats were elected by the uploader.

Creating and storing zip files requires storage space and as the archive has grown this didn't appear to be a sustainable approach, so "zip on the fly" was substituted for new sources a while back.

The zip files are required because http and similar protocols (as I understand it) can't allow you to click a single link and have more than one file sequentially downloaded (such as a directory with the files containing the format you requested).

The tweak that would be useful would be to implement the following logic for the zip on the fly. When you want to download the lossless version, the cgi script on the archive should skip any files that end with either *.mp3 or *.ogg and *.xml. Note that doing this would also have the benifit that you would get any text or jpg or md5 files automatically. The absence of these information files is an annoyance frequently noted by users.

Similar download links could be made available for the different mp3 flavors as well as ogg vorbis. In each case, the "zip on the fly" cgi script would skip file extensions known NOT to be needed. For example, ogg vorbis would skip any files ending with flac, shn or mp3.

This scheme would have these advantages:

1. Efficient use of download bandwidth by providing users with only the source types they want.
2. Allow all source types to be available by single link download (lossless shn or flac, fixed and variable rate mp3 and ogg vorbis) since the cgi logic is similar and there would be no restriction on disk storage requirements at the archive.
3. Include information, md5, jpgs (cover art work, photos) associated with this specific source.

Reply to this post
Reply [edit]

Poster: Cleantone Date: Oct 1, 2005 12:31pm
Forum: etree Subject: Re: lossless download zip link contains all 4 formats of a show (mp3, flac, ogg, 64k mp3) instead of just the flacs...

What I have been doing is using a download manager. I use firefox's extention "downTHEMall!" to select the .flac, .txt, and .md5 files for downloading all at once. Pretty handy.

Reply to this post
Reply [edit]

Poster: Administrator, Curator, or StaffDiana Hamilton Date: Oct 2, 2005 7:48am
Forum: etree Subject: Re: Firefox downloader extension

Wow, thanks for the tip- just installed it and it tests out well for me! :)

Reply to this post
Reply [edit]

Poster: Administrator, Curator, or StaffTyler Date: Oct 2, 2005 8:02am
Forum: etree Subject: Re: Firefox downloader extension

can you link to the FF extension? .. i'd love to give it a test-run...

Reply to this post
Reply [edit]

Poster: Administrator, Curator, or StaffDiana Hamilton Date: Oct 2, 2005 8:17am
Forum: etree Subject: Re: Firefox downloader extension

I found it here:
http://downthemall.mozdev.org/
I've got a custom filter setup for "Lossless" (.shn,.flac,.md5,.txt,.ffp about covers it for me).

This post was modified by Diana Hamilton on 2005-10-02 15:17:49